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^ , Abstract. The motivation of this paper is to prove verification theorems for stochastic 

optimal control of finite dimensional diffusion processes without control in the diffusion 

term, in the case that the value function is assumed to be continuous in time and once 

tH- ' differentiable in the space variable (C°'^) instead of once differentiable in time and twice 

C^ . in space (C^'^), like in the classical results. For this purpose, the replacement tool of the 

>0 ' Ito formula will be the Fukushima-Dirichlet decomposition for weak Dirichlet processes. 

Given a fixed filtration, a weak Dirichlet process is the sum of a local martingale M plus an 

,S^ ' adapted process A which is orthogonal, in the sense of covariation, to any continuous local 

j^ , martingale. The mentioned decomposition states that a C*''^ function of a weak Dirichlet 

process with finite quadratic variation is again a weak Dirichlet process. That result is 

established in this paper and it is applied to the strong solution of a Cauchy problem with 

final condition. 

Applications to the proof of verification theorems will be addressed in a companion paper. 



1 Introduction 

In this paper we prepare a framework of stochastic calculus via regularization in order to 
apply it to the proof of verification theorems in stochastic optimal control in finite dimension. 
The application part will be implemented in the companion paper |18| . 

This paper has an interest in itself and its most significant result is a generalized time- 
dependent Fukushima-Dirichlet decomposition which is proved in sectional This will be the 
major tool for applications. 

The proof of verification theorems for stochastic control problems under classical condi- 
tions is an application of Ito formula. In fact, under good assumptions, the value function 
V : [0, T] X M" — > R associated with a stochastic control problem is of class C^ in time and 
C^ in space (C^'^ in symbols). This allows to apply it to the solution of a corresponding state 
equation (St) and differentiate V{t,St) through the classical Ito formula, see e.g. [lU! pp. 
140, 163, 172]. The substitution tool of that formula will be a time-dependent Fukushima - 



Dirichlet decomposition which wiU hold for functions u : [0,T] x M" -^ R that are C^'^ in 
symbols; so, our verification theorem will have the advantage of requiring less regularity on 
the value function V than the classical ones. 

It is also possible to prove a verification theorem in the case when V is only continuous 
(see e.g. |22], [13 Section 5.2], ^Uj) in the framework of viscosity solutions: however such 
result applied to our cases is weaker than ours, as it requires more assumptions on the 
candidate optimal strategy; see on this the last section of the companion paper JHI where 
also a comparison with other nonsmooth verification theorems is performed. 

We come back to the Fukushima-Dirichlet decomposition as replacement of Ito formula. 
Roughly speaking, given a function u of class C^'^, classical Ito formula gives a decomposition 
of u(i, Sf) in a martingale part, say M (which is thrown away taking expectation in the case 
of deterministic data and expected cost) plus an absolutely continuous process, say A. Then, 
in case of deterministic data and expected cost, one uses the fact that u is a classical solution 
of a partial differential equation (PDE), which is in fact the Hamilton- Jacobi-Bellman (HJB) 
equation, to represent A in term of the Hamiltonian function. If one wants to repeat the 
above arguments when u is not C^'^, a natural way is to try to extend the decomposition 
u{-^S) = M + A and the representation of A via the HJB PDE. This is what we perform 
in this paper in the case when u G C"'^ using a point of view that can be also applied to 
problems with stochastic data and pathwise cost, so the HJB becomes a stochastic PDE, 
see e.g. |1|2S|E1|27|). 

We propose in fact an extension of the classical Fukushima-Dirichlet decomposition. 
That decomposition is inspired by the theory of Dirichlet forms. A classical monography 
concerning this theory is jjl] where one can find classical references on the subject. In 
Theorem 5.2.2 of ^J, given a "good" symmetric Markov process (Xf )j>g and a function 
belonging to some suitable space (Dirichlet space), it is possible to write 

uiXt)^u{x)+M^ + A'^, (1) 

where M is a local martingale and (A")j>q is a zero quadratic variation process, for quasi- 
everywhere x, i.e. for x belonging to a zero capacity set. For instance, if X = ly is a classical 
Brownian motion in R" then the Dirichlet space is H^ (R") and Af" = Jg Vu{Wu)dWu- We 
call (Q a Fukushima-Dirichlet decomposition. Our point of view is of pathwise nature: as in 
|11[I12| . a process Y, as u{X), which is the sum of a local martingale and a zero quadratic 
variation process, even without any link to Dirichlet forms, is called a Dirichlet process. 
However, in jllj . the notion of quadratic variation, even if in the same spirit as ours, was 
defined through discretizations, while we define it through regularizations. Therefore that 
notion of Dirichlet process is similar but not identical to ours. 

The papers i3T] and ^1 reinterpret A in a "pathwise" way as the covariation process 
[Vu (B) , B] transforming (^ in a true Ito's formula; the first work considers u E C^ (M") 
and it extends the framework to reversible continuous semimartingales; the second work is 
connected with Brownian motion and u G H^ (M"). The literature on Ito's formula for non- 
smooth functions of semimartingales or diffusion processes has known a lot of development 
in the recent years, see for instance [25 | for non-degenerate Brownian martingales, !5| for 
non-degenerate 1-dimensional diffusions with bounded measurable drift or jTj in the jump 
case. 

In our applications, the fact of identifying the remainder process A" as a covariation is 
not so important since the goal is to give the representation of it via the data of the HJB 
PDE. So we come back to the spirit of the Fukushima-Dirichlet decomposition. Besides 
our "pathwise" approach to Dirichlet processes, the true novelty of this approach is the 
time-inhomogeneous version of the decomposition; this is in particular motivated by non- 
autonomous problems in control theory. 



This is based on the theory, under construction, of weak Dirichlet processes with respect 
to some fixed filtration {Tt). A weak Dirichlet process is the sum of a local martingale M 
and a process A which is adapted and [A, A^] = for any continuous (J^t)-local martingale N . 
We will be able in particular to decompose u{t^ Dt) when u e C°'^ and D a weak Dirichlet 
process with finite quadratic variation process, so in particular if D is a semimartingale (even 
diffusion process). This will be our time-dependent Fukushima-Dirichlet decomposition: it 
will be the object of Proposition I3.10| and CoroUarv KlllI In particular that result holds 
for semimartingales (and so for diffusion processes). The notion of weak Dirichlet process 
appears also in 0. Our Fukushima-Dirichlet decomposition could be linked to the theory 
of "time-dependent Dirichlet forms" developed for instance by |26l 1351 |21j but we have not 
investigated that direction. 

The paper is organized as follows. In section |21 we introduce some notations on real 
analysis and we establish preliminary notions on calculus via regularization with some re- 
marks on classical Dirichlet processes. Section 3 will be devoted to some basic facts about 
weak Dirichlet process and to the above mentioned Fukushima-Dirichlet decomposition of 
process {u(t,Dt)), with some sufficient condition to guarantee that the resulting process is 
a true Dirichlet process. Section^lwill be concerned with application to the case where u is 
a strong C°'^ solution of a Cauchy parabolic problem with initial condition; C^ solutions of 
an elliptic problem are also represented probabilistically. 

2 Preliminaries 

2.1 Notation 

Throughout this paper we will denote by (fi, JT, P) a given stochastic basis (where T stands 
for a given filtration {J's)gyfj satisfying the usual conditions). Given a finite dimensional real 
Hilbert space E, W will denote a cylindrical Brownian motion with values in E and adapted 
to {J^s)s>o- Given < f < T < -Foo and setting % = [t,T] n M the symbol Cjr {% x Vl; E), 
will denote the space of all continuous processes adapted to the filtration J-' with values 
in E. This is a Frechet space if endowed with the topology of the uniform convergence in 
probability {u.c.p. from now on). To be more precise this means that, given a sequence 
(X") C Cjr {% X n- E) and X (^Cjr {% x Vl; E) we have 

A"^X 

if and only if for every e > 0, ti € 7^ 

hm sup P {\Xl! - A^l p > e) = 0. 

"^+°°se[t,ti] 

Given a random time t > t and a process {Xs)seTti we denote by X"^ the stopped 
process defined by AJ = XgAr- The space of all processes in [t,T], adapted to T and 
square integrable with values in E is denoted by L^ {t, T; E). S" will denote the space of all 
symmetric matrices of dimension n. If Z is a vector or a matrix, then Z* is its transposition. 

Let fc G N. As usual C'^ (M") is the space of all functions : M" -^ M that are continuous 

together with their derivatives up to the order k. This is a Frechet space equipped with the 

seminorms 

sup \u{x)\^+ sup \dxu{x)\T^„ + sup \dxxu{x)\T^„y„ 
xeK xeK xgk 

for every compact set AT CC M". This space will be denoted simply by C'^ when no confusion 
may arise. The symbol C^ (M") will denote the Banach space of all continuous and bounded 



functions from M" to R. This space is endowed with the usual sup norm. Passing to paraboUc 
spaces we denote by C" {% x M") the space of aU functions 

u:7ixM"^]R, {s,x)^u{s,x) 

that are continuous. This space is a Frechet space equipped with the seminorms 

sup \u{s,x)\^ 

foreveryii > and every compact set 7^ CC K"). Moreover we will denote by C""^'^ (7^ x K") 
(respectively C°'^ {% x K.")), the space of all functions 

M:7ixM"^M, {s,x)^u{s,x) 

that are continuous together with their derivatives 9tU, dxU, dxxU (respectively d^u). This 
space is a Frechet space equipped with the seminorms 

sup |u(s,x)|jj+ sup \dsu{s,x)\j^„ 

(s,x)G[t,ti]xK (s,x)G[t,ti]xK 

+ sup \dxu{s,x)\g^„ + sup \^xxu{s,x)\^,^x,^ 

{s,x)e[tJi]xK {s,x)e[t,ti]xK 

(respectively 

sup |u(s,x)|jj+ sup \dxu{s,x)\^„) 

(B,x)e[t,ti]xK (s,x)£[t,ti]xK 

for every ti > and every compact set K CC M". This space will be denoted simply by 
C^'^ (respectively C'^'^) when no confusion may arise. 

Similarly, for a,/3 e [0, 1] one defines C°'-^+'^ {% x K") (or simply 0°"-^+^) as the sub- 
space of C°'^ (7^ X M") of functions m : 7^ x R" i— > R such that are u(-,x) is a— Holder 
continuous and dxU (s, •) is /9— Holder continuous (with the agreement that 0-H61der conti- 
nuity means just continuity). 

Similarly to C^ (R") we define the Banach spaces Cl {% x R") Cl'^ {% x R"), C^'^+'^ {% x R"), 
Cfc"^' {Tt X M"). 

2.2 The calculus via regularization 

We will follow here a framework of calculus via regularizations started in [221 ■ At the moment 
many authors have contributed to it and we suggest the reader to consult the recent survey 
paper |S1] on it. 

For simplicity, all the considered processes, excepted if we mention the contrary, will be 
continuous processes. We first recall some one dimensional consideration. For two processes 
{Xs)g^Q, (Ys)s>oj ^6 define the forward integral and the covariation as follows 

r^ Y — Y 
Xrd'Yr = hm / Xr^-^ -dr, (2) 

[X, Yl ^lim- f {Xr+e - Xr) [Yr+e ~ Y^) dr, (3) 

"^^0 £ Jo 

if those quantities exist in the sense of u.c.p with respect to s. This ensures that the forward 
integral defined in (0) and the covariation process defined in Q are continuous processes. 
It can be seen that the covariation is a bilinear and symmetric operator. 

We fix now, as above, < t < T < +00 and set % — [t,T] n R. A process {Xs)g^q- 
can always be extended (if T < +00) to a process indexed by R+ by continuity. The 



corresponding extension will always denoted by the same symbol. Given two processes 
{Xs)s^q- , {Ys)s^q- , wc define the corresponding stochastic integrals and covariations by the 
integrals and covariation of the corresponding extensions. We define also integrals from t to 
s as follows. 



x,,-Y,^i a,.-k-/\m-.;. 



It Jo JO 

If r > t is a random (non necessarily) stopping time, the following equality holds: 

[X,YY :^[X^,Y^]. (4) 

If (X^,...,X") is a vector of continuous processes we say that it has all its mutual co- 
variations (brackets) if [X*,X-^] exist for any 1 < i,j < n. If X^,...,X'^ have all their 
mutual covariations then by polarisation (i.e. writing a bilinear form as a sum/difference 
of quadratic forms) we know that [X*,X^] (1 < i,j < n) are locally bounded variation 
processes. 

If [X, X] exists, then X is said to be a finite quadratic variation process; [X, X] is called 
the quadratic variation of X. If [X, X] = then X is said to be a zero quadratic variation 
process. A bounded variation process is a zero quadratic variation process. If 5*^, S"^ are 
(JRi)-semimartingales then [S^jS"^] coincides with the classical bracket l^S^^S'^). If i/ is a 
(^s)-progressively measurable process then J Hrd~ Sr is the classical Ito integral J, HrdSr- 

Remark 2.1 Let X (respectively A) be a finite (respectively zero) quadratic variation pro- 
cess. Then {X,A) has all its mutual covariations and [X,A] =0. | 

We recall now an easy extension of stability results, see [HI th. 2.9] that will be used in 
subsection 13.31 

Proposition 2.2 Let V ~ (V^ , ...V"^) (respectively X — (X^,...X")J be a vector of con- 
tinuous processes on K.+ with bounded variation processes (respectively having all its mutual 

covariations). Let f,g e C^'^'^'^ (M™ x M") (■y > 0). Then Vs > 

[f{V,X),g{V,X)l^Yl / d^J{V,X)d^^g{V,X)d[X\Xq^. 

Proof. We give a sketch of the proof as the arguments are similar to the ones used in 

[HI th. 2.9]. By localisation Cj^^ ' can be replaced by C^+t^^. The case where / and g 
do not depend on V was treated for instance in [SUl [32] . Since the covariation is a bilinear 
operation, using polarisation techniques we can take g = f. For simplicity we set here 
m — n = 1. For given e > we write, when r £%, 

f {Vr+e, Xr+e) " / {Vr, Xr) = Jl (r, s) + J2 (r, e) , 

where 

Jl(r,£) = f [Vr+e, Xr+e) ~f{Vr, Xr+e). 
J2{r,e) = f{Vr,Xr+e)-f{Vr,Xr). 

Therefore, for s > 

- f [f [Vr+e, Xr+e) -f{Vr,Xr)fdr<- I J^r, s) dr + - f J^ {r, e) dr. 
£ Jo ^ Jo ^ Jo 



Now 



- / Jl (r, e) dr < c^ (s, f,V)- f (\Vr+, - K 
e Jo £ Jo ^ 



h+i 



dr, 



where c (s, /, V) is a (random) Holder constant of / such that 



\f{vi,x) - f {V2,X)\ < c{sJ,V)\vi -V2\ 



h+f 



Vwi , V2 G 



inf Vr, sup Vr 

re[0,s] re[0,s] 



VxG 



inf Xr, sup X,. 

re[0,sl re[0,s] 



Then we get 



- /' J2 (r, £) dr < c' (s, /, y) - /' \Vr+, 
£ Jo £ Jo 



Vr 



1 1+27 



dr. 



Since y is a bounded variation process, this term converges to zero in probabiUty. 
On the other hand, 

J2 (r, e) = a,/ {Vr, Xr) {Xr+e - Xr) + h (r, s) , 

where J3 (r, e) converges u.c.p. to zero, as in S, th. 2.9]. Therefore, similarly as in |30 | we 
have 

- / Jl{s,e)ds^ V / {dJ{V,,Xs))^d[X,Xl 
£ Jo ,j^^Jo 

and so the claim. I 



For our purposes we need to express integrals and covariation in a multidimensional 
setting, in the spirit of [H|. 

li X = {X^ , ..., X") is a vector of continuous processes in IR+, F is a to x n matrix of 
continuous processes in IR+ , (^*'"') i<j<,„ i< <„ then the symbol J^ Yd~X denotes, whenever 
it exists, the u.c.p. limit of the integral L Yr ''+'^ — ^dr where the product is intended in 
the matrix sense. Similarly, il yl is a n x d matrix {A^^'') kkw then [i^, ^]^ is the 

m X d real matrix constituted by the following u.c.p. limit (if it exists) 



{Yr+e - Yr) (A 



r+e 



Ar) dr. 



Clearly the matrix operation cannot be commutative in general. Let now A, X, Y, C be real 
matrix valued processes which are successively compatible for the matrix product. We define 



/ Ard [X, Y],^ Cr = hm - / A,. (X^+^ - Xr 
Jo '^"*o £ Jo 



- Xr) (1;+, - Yr) Crdr, 

where the limit is intended in the u.c.p. sense. The previous stability transformations (Propo- 
sition |^| above) can be extended to the case of vector valued functions. This is pointed out 
in next remark. 

Remark 2.3 Let f e c|^'''^ (R+ 



xM«;MP),geCit+^'' 



xw"-m),x ^ (xi,...,x") 

Y = (y^,...,y") such that {X,Y) has all its mutual covariations. Let V^,V'^ be bounded 
variation processes. Then 

[f{V\X),g{V',Y)]^^ rdj{V\X)d[X,Y*]d,g{V',Y)* 

Jo 

for every s > 0. | 



One refined result is the vector Ito formula whose proof follows similarly as in |3(J[ 15). 
where the involved stochastic integrals were scalar. 

Proposition 2.4 Let f e C^''^ {% x R"). Let X = (X\ ...,X")*, having all its mutual 
covariations, V he a hounded variation process indexed hy 7^. Then, for < s < t, 



f{Vs,Xs) = fiVt,Xt)+l d,f{Vr,Xr)d-Xr 
dJ{Vr.Xr)dVr 
+ \j d^J{Vr,Xr)d[X,X*]. 

Remark 2.5 From the above statement it follows that, in particular, the integral L dxf (K-, X^) d~Xr 
automatically exists. I 

Remark 2.6 Let W = {W^, ...,W"-)* be an {Ts)-Brownian motion. Then [W,W*]^ = 

3 Fukushima-Dirichlet decomposition 

3.1 Definitions and remarks 

Throughout all this section we fix, as above, < i < T < +oo and set Tt = [t, T] flM. Recall 
that all processes we consider are continuous except when explicitely stated. 

Definition 3.1 A real process D is called an {!Fs)-Dirichlet process in Tt if it is {J-s)-adapted 
and can he written as 

D = M + A, (5) 

where 

(i) M is an {Tg)- local martingale, 

(ii) A is a zero quadratic variation process such that (for convenience) Aq — Q. 

A vector D — {D^ , ..., 13") is said to be Dirichlet if it has all its mutual covariations and 
every D' is Dirichlet. 

Remark 3.2 An {J-s)-semimartingale is an {J-s)-Dirichlet process. | 

Remark 3.3 The decomposition {3[) is unique, see for instance fA'Af . | 

The concept of Dirichlet process can be weakened for our purposes. We will make use of 
an extension of such processes, called weak Dirichlet processes, introduced parallelly in [H] 
and implicitely in |S]. Recent developments about the subject appear in pilH^IS], 

Weak Dirichlet processes are not Dirichlet processes but they preserve a sort of orthogonal 
decomposition. In all the papers mentioned above however one deals with one-dimensional 
weak Dirichlet processes while here we treat the multidimensional case. 



Definition 3.4 A real process D is called (J- s) -weak Dirichlet process in % if it can, be 
written as 

D = M + A, (6) 

where 

(i) M is an (J-'g) -local martingale, 

(ii) A is a process such that [A, iV] = for every [J- s)- continuous local martingale N . (For 
convenience Aq — Oj 

A will he said weak zero energy process. 

Remark 3.5 The decomposition \B^ is unique. In fact, let 

D = M^ +A^ ^M^ +A^, 

where M^, M'^, A^ , A^ fulfill properties (i) and (ii) of Definition \3.4\ Then we have M + A = 
where M = M^ - AP and A ^ A^ ~ A^ is such that [A, iV] = for every {Ts)- local 
martingale N. 

It is now enough to evaluate the covariation of both members with M to get [M, M] — 0. 
Since ^o = then AIq — and consequently M = 0. | 



Example 3.6 A simple example of weak Dirichlet process is given by a process Z which is 
independent of J- , for instance a deterministic one! Clearly if Z is not at least a finite 
quadratic variation process, it cannot be Dirichlet. However it is possible to show that 
[Z, A'^] = for any local J-' -martingale. In fact 

r+s 

'dNx 



[ iZr+e-Zr){Nr+,-Nr)dr = [ dr{Zr+e - Z,) [ - 

Jo Jo Jr ^ 

{Zr+e ~ Zr)dr 



dNx '^ 



(A-e)VO 

dNx [^ r. , r dNx '^ 



Zrdr. 

(A-e)VO ^0 t "'(A-e)VO 

Previous expression converges u.c.p. to zero since the two last terms converge u.c.p. to 
the ltd integral L ZdN since N is also a local martingale with respect to the filtration J-' 
enlarged with Z . 

Remark 3.7 "^1 provides an example of weak Dirichlet process coming from convolutions 
of local martingales. If for every s > 0, {G{s,-)) is a continuous random field such that 
{G{s,-)) is (J-'r) -progressively measurable and M is an {Tr)-local martingale, then Xs = 
/j G{s,r)dMr defines a weak Dirichlet process. I 

Remark 3.8 ^7/ made the following observation. If the underlying filtration (J-s) is the 
natural filtration associated with a Brownian motion {Wt) then condition (ii) in Definition 
\!^.4\ can be replaced with 

(ii') A is a process that [A, W] = 0. I 



Definition 3.9 A vector D = {D^, ....D") is said to be a {Ts)-weak Dirichlet process if 
every D^ is (J-'s)- weak Dirichlet process. A vector A = (A^,...,v4") is said to be a {Tg) -weak 
zero energy process if every A^ is (J^s)- weak zero energy process. 

The aim now is to study what happens to a Dirichlet process after a C"'^ type trans- 
formation. It is weU known, see for instance |33| . that a C^ function of a finite quadratic 
variation process (respectively Dirichlet process) is a finite quadratic variation (respectively 
Dirichlet) process. Here, motivated by applications to optimal control, see the introduction, 
section n we look at the (possibly) inhomogeneous case showing two different results: the 
first result fProposition lS. 101 with Corollarv l3.11|l states that a function C°'^ (M+ x R") of a 
weak Dirichlet (vector) process having all its mutual covariations is again a weak Dirichlet 
process; the second f Proposition 13.1^ gives stability for Dirichlet processes in the inhomo- 
geneous case for functions in Cj^^ "'' {% x M"). 

The first result comes from the need of treating optimal control problems where the state 
process is a semimartingale that solves a classical SDE's, which is the case we treat in the 
companion paper [T^ . 

3.2 The decomposition for C°'^ functions 

We now go on with a result concerning weak Dirichlet processes. Suppose {Ds) ^^q- to be an 
(.?^s)-Dii'icblet process with decomposition |(SJ where ^ is a zero quadratic variation process. 
Given a C°'^ function u of D, we cannot expect that Z = u{-,D) is a Dirichlet process. 
However one can hope that it is at least a weak Dirichlet process. Indeed this result is true 
even if _D is a weak Dirichlet process with finite quadratic variation. 

Proposition 3.10 Suppose (0^)^^^ to be an (J-s)- weak Dirichlet (vector) process having 
all its mutual covariations. For every u g C°'^ (]R_|_ x R") we have, for s > t, 

u (s, Ds) = u {t, Dt) + I d^u (r, Dr) dMr + B'^ [u)^ - B^ {u)^ , (7) 

where B^ : C^'^ (M+ x M") -^ Cjr (M^ x f2;M") is a linear map having the following proper- 
ties: 

a) B^ is continuous; 

b) ifue Ci'2(R+ xR") then 

S^(m), = [ dsu{r,Dr)dr+ [ d.^uir, Dr) d[M, M]^ + [ d^u {r, Dr) d' Ar; 
Jo Jo Jo 

c) if u E C"'^ (R-|_ X R") then ({B^ ('")s) *■' ^ weak zero energy process. 

Corollary 3.11 Suppose (^t)t>o to be an {Tt)- weak Dirichlet (vector) process having all 
its mutual covariations. For every u £ C*^'^ {M.^ x M") , {u{t,Dt) is a {J-t)-weak Dirichlet 
process with martingale part Mt — L dxu{s,Ds)dMs. 

Remark 3.12 Given a bounded stopping time t with values in %,, it is easy to see that 
decomposition TO still holds for the stopped process D"^ . In fact given an {^s)- rnartingale 
N , and an (J-'s)- weak zero energy process A, we have [N,A'^] = [N.,AY = 0. | 



Proof (of the Proposition). Without restriction of generahty we wiU set t — 0. 
Property a) foUows simply by writing 

B" (u)^ = u (s, Ds) - u (0, Do) - / d.,u (r, Dr) dMr 

JO 

and observing that the process defined on the right hand side has the required continuity 
property. 

Property b) foUows from Proposition lT^ apphed reversely. Indeed, given u G C^'^ (M+ x M"), 
Proposition 12 .41 can be applied. In particular 



exists; this implies that also 



/ dxU (r, Dr) d Dr 
Jo 



dxU (r, Dr) d Ar 



exists since 

/ dxU {r, Dr) d^ Mr ^ / dxu{r,Dr)dMr 
Jo Jo 

is the classical Ito integral. 

It remains to prove point c) 



u{-,D)- / dxu{r,Dr)dMr,N 



= 



for every one dimensional (.?>)- local martingale N. 

For simplicity of notations, we will suppose that D is one-dimensional. Therefore D will 
be therefore a finite quadratic variation proces. Since the covariation of semimartingales 
coincides with the classical covariation 



dxu{r,Dr)dMr,N 



it remains to check that, for every s G [0,T], 



dxu{r,Dr)d[M,Nl, 



[u{;D),Nl^ dxu{r,Dr)d[M,Nl. 

JO 



For this, we have to evaluate the u.c.p. limit of 



Nr+e - Nr 



[u [r + e, Dr+e) - u {r, Dr 
10 " £ 

in probability. This can be written as the sum of two terms: 



dr 



/i(s,e)= / {u{r + e,Dr+e) -u{r ^^e^Dr))^^ -dr, 

/o e 



h (s, e) - / {u{r + e, Dr) ~ u (r, Dr)) 



N, 



r-\-e 



Nr 



-dr. 



First we prove that /i (s, e) goes to /„ d^u (r, Dr) d [M, N]^. In fact 



/i(s,e) 



[u (r + e, Dr+e) ~ u{r + e, Dr)) 



N, 



r+£ 



Nr 



-dr 



rs N — N 

/ dxU (r + £, Dr) {Dr+e - Dr) ^^ -dr + Ri (s, e) 

Jo e 



(8) 



10 



where Ri (s, e) — > u.c.p. as e — > 0. Indeed 



Ri{s,e) = [d^u{r + e,Dr + X{Dr+e-Dr))-d.^u{r + s,Dr)]dX 

Jo Uo 



(Dr+e — Dr 



dr 



and the claim follows by the continuity of dxU and from the estimate 



- f [Nr+e - Nr) {D^+e - Dr) dr 

£ Jo 



< 



- I (Nr+e ~ Nrf dr ■ - f (A-+e - D^f dr 

£ Jo £ Jo 



e^O 



{[N]-[D]Y. (9) 



On the other hand the first term in © can be rewritten as 



dxU (r, Dr) (Dr 



Dr 



*rH-e -^ * r 



dr -\- R2 {s,e) , 



(10) 







where R2 {s,e) -^ u.c.p. arguing as for i?i (s,e). The integral in ((117)) goes then u.c.p. to 
J^ dxu{r,Dr) d[M,N]^, since by (jHl the measures ^ '"''°~ "^'^ '"''°~" — —dr weakly converge 
to d[N,D] as e ^ 0. 

It remains to show that I2 (s, e) — > u.c.p. for every s G [0, T] as £ — + 0. By using suitable 
localization theorems (e.g. as usually done for instance in I^S], section IV. 1), it is enough to 
suppose u to be with compact support and iV to be a square integrable martingale. Then 
we evaluate 



E sup |/2(s,e)|' 

\0<s<T 



(11) 



Now we have, exchanging integrals 



h{s,e) 



[u{r + e,Dr)-u{r,Dr)] 



Nr + r - Nr 



-dr 



[u{r + e, Dr) — u{r, Dr)]dr 



e 

r+E 1 

e 



dN, 



dNx 



lO ^ J(A-e)VO 

Doob inequality implies that (|11|1 is smaller than 



[u{r + e, Dr) — u{r, Dr)]dr. 



Al^'^'^^ilL 



(A-e)VO 



i{r + £, Dr) — u{r, Dr)]dr 



The fact that u is uniformly continuous on compact sets and the Lebesgue dominated con- 
vergence theorem imply the result. I 

A significant bracket evaluation, in the spirit of Proposition |^21 but for C"'^— functions 
of semimartingales is the following. For simplicity we formulate the one-dimensional case, 
even if it extends to the multidimensional case. 
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Corollary 3.13 Let S be a {Tg)- semimartingale in IR+, u £ C'^'^{Tt x R). Then 

[u{-,S),S]t= / d^u{s,Ss)d[S]s. 

Proof. Let S — M + V he the decomposition of 5* with M being a local martingale and 
V a finite variation process with Vb = 0. Then 

u{t, St) = w(0, So) + f dMs, Ss)dMs + At, 
Jo 

where ^ is a weak zero energy process. In particular, a classical localization argument shows 
that [A, M] = 0. On the other hand, obviously [A, V] — 0; consequently, by linearity and 
since the covariation of local martingales is the classical convolution, the result follows. | 



3.3 The decomposition for C^^'^'^ functions 

If, in Proposition 13. lOl _D is a Dirichlet process and u is of class C^'^'^-^, 7 > 0, then the 
results of Proposition 13 . 1 01 and CoroUarv 13 . 1 II can be better precised. In fact it is possible 
to show that Dirichlet processes are stable through C^'^'''^, 7 > transformations. 

Proposition 3.14 Let (-C's)s>o ^^ '^'^ {Ts)-Dirichlet process with decomposition |3[). The 
statement of Provosition ^. 1(A holds with 

fulfilling properties a), b) and 

c) if u ^ C^^'''^ (R+ X R") then (B^ ('")s) *•' '^ •^^'"'^ quadratic variation process. 

Proof. Points a) and b) follow similarly as for the C°'^ decomposition. 

In order to establish Property c) we proceed using the bilinearity of the covariation. We 
will in fact show that B^ {u) is a zero quadratic variation process. We operate with the 
bilinearity of the covariation process and we evaluate 

(i) [u{;D),ui;D)], 

(ii) [ui;D)J^d,uir,D,)dM,], 

(iii) [/o d^u (r, Dr) dMr, /o d^u (r, Dr) dMr] , 

as follows. 

(i) We apply Proposition 12. 21 to get that 

[u{;D),ui;D)l= f d.,u{s,Dr)d[D,D\d^u{r,Dr)* . 
Jo 

(ii) Setting Nt = /„ dxu{r, Dj.) dM^, Remark 12.11 implies that {N,D) has all its mutual 
brackets; therefore again Proposition 12 . 21 implies that 



[u{;D),N*]^^ / d,u{r,Dr)d[D,N*l. 
Jo 

On the other hand, by Remark l2.1l 

[D, N\ = [M, N*]^ = / d^u (r. A-) d [M, M*l d^u (r, Dr)* 
Jo 
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(iii) The fact that the covariation of semimartingales coincides with the classical covariation 
gives 

/ dxu{r,Dr) dMr, / d^u {r, Dr) dM^ 
Jo Jo 



d,u (r, Dr.) d [M, M*l d^u (r, Dr)* 

10 

Finally by Remark |2. II and the decomposition we get that 

[D, D*] = [M, M*] . 

The bilinearity of the covariation allows now to conclude. 



4 Representation of operator B when u solves a suitable 
PDE. 

Here we want to develop the connection between suitable (deterministic) linear differential 
operators and our (stochastic) operators B introduced in the previous section. This connec- 
tion is well known and obvious when u is the C^'^ solution of a second order PDE and D 
is a diffusion process. Our aim is to extend the validity of such representation when u is 
only a C"^^ solution (in a suitable sense that we will define below) and _D is a weak Dirichlet 
process of a suitable kind (see below) . This will be used as a key tool in the applications to 
optimal control. 

4.1 Strong solutions of parabolic PDE's 

Let < r < +0O, consider two continuous functions 

b : [0, T] X M" ^ K", a: [0, T] x M" ^ £ (M", R") 

and the linear parabolic operator 

Co ■■ D {Co) C C" ([0, T] X M") — > C" ([0, T] x M") , 
DiCo) = C^^mO,T]xR^), 
Cou (t, x) = dtu [t, x) + {h (t, x) , dxU (t, x)) + -Tr [a* {t, x) d^xU {t, x) a (t, x)] . 
Defining 

Lo (t) u {t, x) = {b {t, x) , d^u {t, x)) + -Tr [a* {t, x) d^xU {t, x) a (t, x)] , 

we can write 

Cqu {t, x) — dtu {t, x) + Lq {t) u {t, x) . 

Recall that an operator Ai : D {A4) C F ^ G {F, G suitable Frechet spaces) is closable if, 
given any sequence (w„)„gpf C D (7W), we have 

Mun — > rj m G J 
13 



When Cq is closable we denote by C its closure and recall that 

u^D{C)^=^3 (u„) C Ci'2 ([0, T] X M") : ( "" ^ " . in C° ([0, T] x M") . 

Now, given e C° (M") and /i G C° ([0,T] x M") we consider the inhomogenous back- 
ward parabolic problem 

dtu {t, x) + {b {t, x) , dxU {t, x)) + ^Tr [a* (t, x) d^^u {t, x) a {t, x)] — h {t, x) , 

te[0,T], xeR", (12) 

M (T, a;) = (/) (x) , xGR", 

that can be rewritten as 

dtU (i, x) + Lq (i) u {t, x) = h {t, x) , u (T, x) — 4> {x) , 

or 

Cqu [s, x) = h [s, x) , u (T, x) — 4> {x) . 

Definition 4.1 We say that u E C'^ ([0, T] x R") is a strict solution to the backward Cauchy 
problem J^l'^) if u G D (Cq) and MUfi holds. 

Definition 4.2 We say that u E C°([0,r] x M") is a strong solution to the backward 
Cauchy problem fjji)) if there exists a sequence (u„) C D (Cq) and two sequences ((/)„) C 
C° (R"), (hn) C C° ([0,T] X M"), such that 

1. For every n E N Un is a strict solution of the problem 

CoUn {t, x) = hn {t, x) , u„ (T, x) = 0„ (a;) . 

2. The following limits hold 

u„ — >u in C"([0,r] xR"), 
hn — >h mC°{[0,T] xR"), 
(pn — >(/> in C° (R") . 



4.2 The representation result 

Let M be a strong solution of class C'^'^ of (|12|l and S* be a weak Dirichlet process that can 
be written in the following form: 

St = So+ f a{s,Ss)dW,+At 
Jo 

where a is as in the previous section and A is a weak zero energy process with finite quadratic 

variation. 

We observe that for our applications to optimal control it would be enough to take S 
semimartingale. We deal with this more general case to prepare the field for a forthcoming 
paper in which we consider the optimal control of solutions of SDEs where the drift b is 
the derivative in space of a continuous function /3, therefore a Schwartz distribution. One 
would have in that case At = "/^ dxP[s,x)ds'^ in some specific sense. Equations of that 
type, when there is no dependence in time appear for instance in |^. Solutions are Dirichlet 
processes in the time-homogeneous case and weak Dirichlet in the general case. 

We remark that the coefficient a must coincide with the one appearing in the second 
order term of the operator. 

We state first a technical lemma whose proof is elementary. 
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Lemma 4.3 Let T < +cx3. Let fn,f : [0,T] ^ R, n G N, continuous such that /« — > / 
uniformly. For a fixed constant K > 0, we define 

r„ = inf {i e [0,r] : |/„ (t)| > K} , r = inf {i € [0,T] : \f {t)\ > K} 

with the convention that inf = T. Then 

lim /-"(T) = r(r) 

n— >+oo 

where f^ (respectively f^'^) is the stopped function defined by /^ (t) = / (r A t) (respectively 

/,I"W = /«KAt);. 

^From the above lemma we get the fohowing Proposition. 

Proposition 4.4 The set A4ioc of all (J-t) —continuous local martingales is a closed subset 
of Cyr ([0,r] X Q;M.) endowed with the u.c.p. topology. 

Proof. Let (M„ (t) , t e [0, r])^|-pj be a sequence of local continuous martingales con- 
verging u.c.p. to a continuous process Af G Cjf([0,T] x 51; R). For K > we define the 
following stopping times: 

r"=inf{te[0,r]:|M„(t)|>if} 

r = inf{f e [0,r] : \M {t)\ > K} 

with the convention that inf = T. 

In order to conclude, it suffices to show that M'^ is a square integrable martingale. 
Lemma [4. 31 implies that 

Mn\T) — >M^{T) a.e. (13) 

Using l(T^ above and Lebesgue dominated convergence theorem, we have 

M^" (T) — > W (T) in L^ [Vl) . 

The fact that Af^ is a square integrable martingale follows then from Proposition 5.23, Ch. 
lof^ffl- ■ 

We are now able to state a useful representation result. Below we fix t G [0, T] and, since 
now T < +00, we have % = [i, T]. 

Theorem 4.5 Let T < +cx3 and 

b : [0, T] X M" -^ M", resp. a : [0, T] x M" ^ £ (M™, M") 

&e continuous functions. Let u G C'''"'^ ([0, T] x M") be a strong solution of the Cauchy 
problem \1^) . 

Fix t G [0,T], X G M" and let (Ss)seTt be a process of the form 



S.= 



I a{r,Sr)dWr + At-A, 



where {As)seTt ^^ '^'^ {J- s) -weak zero energy process having all its mutual covariations. 
Then, provided that the following assumption is verified for every s G %: 



n — ^ + 00 



lim j {dxUn{r, Sr) — dxu{r, Sr))d Ar (14) 

{dxUn{r, Sr) ~ dxu{r, Sr), b{r, Sr)) dr = 0, u.c.p., 
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we have 

m(s, Ss) = u{t, St) + I d^u (r, Sr) air, Sr)dWr + B'^ {u)^ - 6^ (u), , (15) 

where, for s ^ 71 

B^iu)^^ f hir,Sr)dr+ f d.,u {r, Sr) d^ A,. - f {d^u{r,Sr) ,b{r,Sr)) dr. (16) 
Jo Jo Jo 

Proof. We set t = for simplicity. The general case is obtained by additivity of different 
integrals. Let w„ — > u in C° ([0,T] x R") be a sequence such that C[)Un = hn — > h in 
C° ([0,T] X R"). By Proposition O we get 

u„{s,Ss) = u„{0,So)+ CaUn (r, Sr) dr ~ {dx:Un{r, Sr) ,b{r,Sr)) dr 

Jo Jo 

+ / dxUn {r, Sr) a (r, Sr) dWr + dxUn{r,Sr)d^Ar. 

Jo Jo 

^From ()14|l we conclude that 

M" = Un{s,Ss) -Un{0,So) - jCoUn {r, Sr) dr 

Jo 

+ / {dxUn (r, Sr) , b (r, 5"^)) dr - d^Un (r, 5"^) d~Ar 
Jo Jo 

converges u.c.p. to 

M, = u {s, S,) - u (0, So)~ f h (r, Sr) dr 

Jo 

+ f {d.,u (r, Sr) , b (r, Sr)) dr f d^u (r, Sr) d'A, 
Jo Jo 

Using Proposition 14.41 above we get that M is an (.Fs)-local martingale. The result follows 
by Proposition 13. 101 where dM = (7{s, Ss)ds and D = 5', by identification of the weak zero 
energy processes. I 

For our applications in \\3\ we will need to consider a process A which is of bounded 
variation (so that S is solution of an SDE) but which is non-Markovian. 

Corollary 4.6 Let T < +oo and 

bi-.nx [0,T] xK" ^R", 
be a continuous progressively measurable field (continuous in (s, x)) and 

b : [0, T] X R" ^ R", cr : [0, T] x R" ^ £ (R™, R") 

be continuous functions. Let u G C^'^ {[0,T] x R") be a strong solution of the Cauchy 
problem 1^1^) . 

Fix t G [0,T], X G R" and let (Ss) be a solution to the SDE 

dSs ^bi{s,Ss)ds + o-{s,Ss)dWs; St = x. 
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Then, provided that the following assumption be verified for every s d Tt 

lim / {da;Un{r,Sr) - dxu{r,Sr) ,bi{r,Sr) ~b{r,Sr))dr = 0, u.c.p., (17) 

n— ^+oc J . 

^15p holds with 

B^{u)^^ f hir,Sr)dr+ f {d^u {r, Sr) bi {r, Sr)) dr - f {d,u (r, Sr) b (r, Sr)) dr. 
Jo Ja Ja 

Proof. The result follows setting 

As = bi{r,Sr)dr 



Jo 
in previous Theoreni l4.5l I 

The above result depends on the extra assumption (|17|) which is essential but not easy 
to check. We give first a special (but useful) case where it holds and then an improvement 
for the nondegenerate case. We have the following. 



Remark 4.7 // 



lim d^Un = d^u in C° ([0, T] x R") 

n — > + oo 



then Assumption \i4\j is verified. This means that the result of Proposition \J^ above applies 
if we know that u is a strong solution in a more restrictive sense, i.e. substituting the point 
2 of Definition \4.S\ with 

Un — >u mC°{[0,T] X M") 
d^Un — > d^u in C° ([0,T] x M") 
hn — >h inC"{[0,T] xM") 
4>n — > m C" (M") . 

This is a particular case of our setting and it is the one used e.g in 115[ \lf\ \17l to get the 
verification result. We can say that in these works a result like Theorem \4.5\ is proved under 
the assumption that u is a strong solution in this more restrictive sense. It is worth to note 
that in such simplified setting, the proof of Theorem \4-5\ follows simply by using standard 
convergence arguments. In particular there one does not need to use the Fukushima-Dirichlet 
decomposition presented in Section So, from the methodological point of view there is a 
serious difference with the result of Theorem\4.5\ see {I8j . Section 8 for comments. | 



A more significant achievement concerns the nondegenerate case. It is illustrated in the 
following corollary. 

Corollary 4.8 We make the same assumption of Corollary \4.b\ except \i4\j which we replace 
by the assumption that 

a^^ (61 — b) is bounded. (18) 

where a~^ stands for the pseudo-inverse of a. Then the same conclusion of Corollary \4. 6] 
holds. 



17 



Proof. Setting t = for simplicity we write 

Ps^Ws+ f {<J-^ibi-b)){r,Sr)dr 
Jo 

and, applying Girsanov Theorem, there is a probability Q equivalent to P on {n,TT) such 
that {Ps)s^m T] is an (.?'s)-standard Brownian motion. 
So, under Q the process (Ss) fulfills the equation 

dSs — b (s, Ss) ds + a (s, Sg) dWs\ Sq = x. 

Under Q, Assumption (|14|l is trivially verified since b — bi and so we have (the tilde stands 
for operators under the new probability Q) 



and 



B" (u)^ = / h{r, Sr) dr 
Jo 



u (s, Ss) = u (0, S-o) + / d^u (r, Sr) (J (r, Sr) d/3. + B" {u)^ 
Jo 



Expressing (3 in terms of W we obtain the result. ■ 

4.3 Some useful consequences 

The previous results have some important consequences. 

Remark 4.9 From Remark \3.1^ it follows that the conclusion of the above Corollary \4.S\ 
holds also if we stop the processes B{u) with a stopping time t < t < T. More precisely we 
have 

B'^iu)^^^^ r \{r,Sr)dr- f \d,u{r, Sr) ,bi{r, Sr) - b{r, Sr)) dr. 
Jo Jo 

This fact will be useful in 118J, Section 6. I 

Remark 4.10 The results of the Corollary \4. 6] and of Corollary \4.8\ above still hold true 
with suitable modifications if we assume that, instead of having u £ C^'^ {[0,T] x R").- 

(i) the strong solution u belongs to C° ([0,T] x R") n C'^ ([e,T] x M") for every small 
e > 0; 

(a) for some f3 G (0, 1) the map {t, x) -> t'^d^u {t, x) belong to C°'^ ([0, T] x R"). 

The proof of Corollary X^-bX in this case is a straightforward generalization of the one pre- 
sented above: we do not give it here to avoid technicalities. In fact in proving the verification 
theorem in \lt^ . Section 6, we will deal with initial data that are only continuous so with 
solutions u satisfying (i) and (ii) above and possibly not C^'^ . This difficulty will be faced 
directly in the proof of verification Theorem 6.19 in ]lt^ by approximating the initial data 
with C^ ones, using llh]) and passing to the limit. I 

Remark 4.11 From the above Corollary \4.b\ it follows that the process B (u)^ is in fact a 
semimartingale (and also absolutely continuous). I 
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4.4 The elliptic case 

We devote the last part of this subsection to apply the same setting above to elliptic prob- 
lems. Consider the inhomogenous elliptic problem 

Xu{x)+Lou{x)+h{x)^0, VxeR". (19) 

where D (Lq) ^ C^ (M") and 

Lqu (x) = {b (x) , dxU (s, x)) + -Tr [a* (x) d^xU {x) a {x)] . 

Definition 4.12 We say that u is a strict solution to the elliptic problem flUp if u G D {Lq) 
and fiyjl holds. 

Definition 4.13 We say that u is a strong solution to the elliptic problem fl9\) if there 
exists a sequence (u„) C D (Lq) and a sequence (/i„) C C'^ (K"), such that 

1. For every n G N u„ is a strict solution of the problem 

XUn (x) — LqUu (x) — hn (x) , Vx G M". 

2. The following limits hold 

Un — >u inC° (R") , 
hn — >hin C° (R") . 

Note that if L is the closure of Lq in C" (R") then a strong solution u, by construction, 
belongs to D (L). We now exploit the above setting to show that, for functions w G C^ (R") 
that are strong solutions of the elliptic problem (|19|l the following results holds; we omit 
the proof as it is completely similar (and even simpler) to the one of Theorem 14.51 for the 
parabolic case. 

Theorem 4.14 Let 

6i : f7 X R" ^ R", 

be a continuous progressively measurable process (continuous in x) and 

6 : R" ^ R", (7 : R" ^ £ (R™, R") 

be continuous functions. Let Ss be a solution to the SDE 

dSs = bi (Ss) ds + a {Ss) dWs] Sq — x. 

Let u £ C^ (R") be a strong solution of the elliptic problem ^19\) . Assume that 

lim / {dxUn{Sr) - dxu{Sr) ,bi{Sr) - b{Sr))dr = 0, u.c.p., (20) 

or that HS\} holds. Then we have 

u{Ss) = uiSt) + f d,u {Sr) a{Sr)dWr + 6^ (u)^ ~ 6^ (u), , (21) 



whe 



B^ 



{u)^ = r h (Sr) dr + r {dxu {Sr) , 5i {Sr) - b {Sr)) dr. 
Jo Jo 
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